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Radial basis functions are a very powerful tool in multivariate approx- 
imation since they are mesh free. In the theory of radial basis functions, 
the most frequently used error bounds are the one raised by Madych and 
Nelson in and the one raised by Wu and Schaback in especially the 
latter. It seems that Wu and Schaback's error bound is five times more 
frequently used than that of Madych and Nelson's. The reason is that 
Wu and Schaback's space of approximated functions is much easier to 
understand, and their error bound is much easier to use. Unfortunately, 
this error bound contains crucial mistakes which will be pointed out in 
this paper. Moreover, the r.b.f. people have misunderstood its space 
of approximands for long. This will also be discussed in depth. These, 
to some extent, may be a blow to r.b.f. people. However, Madych and 
Nelson's error bound is still very powerful because it's highly related to 
Sobolev spaces which contain solutions of many differential equations. All 
these discussions are based on the central idea of this paper,i.e. unsmooth 
functions should be approximated by unsmooth functions. 



1 Introduction 

Radial basis function interpolation to scattered data {xi, fi) E for pairwise 

distinct points ("centers") xi, . . . , xm S i?" uses a function : i?>o — > R and 
the space Pq of polynomials on i?" with order not exceeding q to construct the 
interpolant 
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(1) 



via the linear system 



M Q 

'^ai(f)(\\xj - Xi\ 



J < M (2) 



M , 

Y,a,pdx,) = Q, 1<^<Q^( '^^l' 

where pi, ■ ■ ■ ,pq are a basis of Pq, and fj means f{xj) with / being the ap- 
proximated function. For a wide choice of and polynomial orders q, including 
the case q — Q = 0, the nonsingularity of the (M + Q) x (M + Q) system 
written as 

in matrix notation, has been established by r.b.f. people. A sufHcient con- 
dition for the linear system to be solvable is that il^{x) := ^(||a;||) should be 
conditionally positive definite of order g(see |21 for its definition). 

The approximated function / should be defined on f2 C i?". There are no 
further conditions on f2. The sampling points Xi are allowed to be irregularly 
distributed over under the restriction 

p(xj) =0, 1 < j < M for p E Pq implies p = Q (4) 

, which guarantees the uniqueness of the solution of the linear system. For local 
error estimation, we measure the "density" of centers Xj near some a; G by 

hp{x) := maXyizKp{x)mini<j<M\\y - XjW 

for some fixed p > 0, where Kp{x) — {y £ i?" : ||x — y\\ < p}, using the 
Euclidean norm 11 • 11. 



2 A brief description of Wu and Schaback's re- 
sults 

Wu and Schaback showed local error bounds of the following form: Given con- 
stants p £ R>Q, q £ -^>0i a radial basis function (p and a certain function 
space to be described below, there exist positive constants k,m £ N, k > 
TO, ho, C £ R such that for any distribution of points Xj £ i?", 1 < j < M, 
any function / from and any point x £ with hp{x) < ho, the inequality 

„ fiP'){x)\ <CfC- h'^-^f'^ix) (5) 

holds for the error and its p-th derivatives for < \p\ < to, where the constant 
Cf depends on f,(j), and F^ only. Then Q is called a local error bound of 
order k. We define |^| :— J2i f^i £ 
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The linear equations are solvable under the hypotheses of the preceding 
section. It follows that there is a Lagrange-type representation 

M 

= ^f{xj)uj{x), Uj{xi) = Sij, 1 < i, j < M, (6) 

of the solution. Introducing vectors 

R{x) mx-xi\\),...,<j>{\\x-XM\\)f (7) 

Six) (pi(x),...,pQ(x)f , (8) 

we get the following theorem. 

Theorem 2.1 The vector U{x) :— {ui{x), . . . ,um{x))'^ formed by the values 
of the Lagrange basis functions Ui, . . . ,um of @) at x Cz i?" coincides with the 
solution (x) of the conditional minimization problem 

min{U^AU - 2U^ R{x) + 0(0) | U G R^' , P^U = S{x)}. (9) 
Proof: omitted. 

We can do the same thing for derivatives. If (j> is differentiable of order 
on (0, oo) and of order 2|/i| around zero, and if ip{x) := the solution 

ui'^\x) of the problem 

min{U^AU -2U'^R^t''>{x)+ij^^'''>{0)\ U e R''^ , P'^ U = S^^^x)} (10) 

uniquely exists. Moreover, the derivative U'^^^x) of U{x) coincides with the 
solution ui^\x) of H10|l . It's worth noting that 

M 

Y,uf{x)-p{x,)^p^^^\x) (11) 

J=l 

for all p £ Pq. The choice of the additive constant in (|10|l is required for the 
following definition. 

Definition 2.1 Let il>{x) — (j){\\x\\) be conditionally positive definite of order q, 
and assume (f> e C'''' (0, oo), (p G C^l^*! around zero for /i G N^^. Then, for any 

distribution of centers cci , . . . , xm satisfying the nonnegative function n^if' 
defined by 

i^q^^ (2; ))2 := min{U^AU - 2U^R^^\x) + ^P^^^\0)\U £ K^^\x)} 
with the set 
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M 

K'if^ ■■= {U={ui,.. .,UMf e = p^f^^x) for allpe PJ (12) 

of admissible vectors is called the Kriging function at x. 

The following theorem is the prototype of Wu and Schaback's main result. 

Theorem 2.2 If the hypotheses of Definition2.1 hold and the Fourier transform 
ip of tp satisfies 

V'(y) = '^(llyll) = t:^^ / e^<y^'>mdt, y G i?", (13) 

then 

M 

i7^^C/-2C/^i?(^)(a;)+^(2M)(o) ^ / | y w,e*<"-*>-(it)^e'<"'*> |2^(t)dt 

(27r)" ^ 

(14) 

for arbitrary [/ — (ui, . . . ,um) G i?*^, expressing the Kriging function via an 
integral. 

Proof: The theorem follows from 

WjWk(t)i\\xj -Xk\\) 

3,k=l 

M 



Jw- ,-T^, 



(27r)" 



j.k=i 

M 



(2^) 



^ j^jY.pe^^''"'^\mt)dt 



and 



1 



{it)''e'<'''-''^'*>ijj{t)dt 



R" 



A 

However, for most of the interesting radial basis functions (j>, does not 
hold. Hence we must develop an approach of generalized functions. 

Theorem 2.3 Let the generalized Fourier transform of = ^(ll^^ll) exist 

and coincide with a continuous function ip on i?" — {0} satisfying 
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o<v.w<c| for H -.00 1 (15) 

with constants c G i?>0 7 sq, Sqo £ where we additionaUy assume 

2|/i| < Soo and sq < 2q (16) 

Then for all U £ K'f'^ {x) we have H14II with a well-defined integral. 

Proof: Let gu{t) X^jii Uje*^^^'*^ — {it)'^e^^^'^^ . By the theorem on mono- 
tone convergence, 



= limrn^^—— I Gm{z)dz (17) 

(271-)" 

with the test functions 

G„At) = \9u{t)\^e^ 

using the definition of the generalized Fourier transform for tempered distri- 
butions. Furthermore, the Fourier transform Gm{z) of Gm can be explicitly 
calculated up to a constant Umn as 



- 2m"(-l)l''I^UfeL'^(e— 

— II s II 

mr'D'^^'{e—^ ), 

where D denotes differentiation with respect to z. Insertion into (17) yields 

A 

We can now write the Kriging function as an integral: 

Theorem 2.4 Under the assumptions of Theorem2.3 the Kriging function has 
the representation 

M 

(18) 

with i^^''^ defined as in H12() . and the integral exists in the classical sense. A 

Lemma 2.1 If the data {xj,fj) stem from an absolutely integrable real-valued 
function f on i?" with a nicely behaving Fourier transform f satisfying 
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(27r) 

then 



fi^) = 7^7 / e'^^''>f{t)dt, X e ii", (19) 



(20) 

where 0, /i are as in Definition2.1 and . . . , um{x) are Lagrange interpola- 

tion functions. 



Proof: Note that 
s<^^Hx) - f'^^^Hx) = ^/(:r,)^''^(^)-/^^H^) 



i=i 

M 



— — / (^^.5'^)(x)e'<--*>-(^^)'^e'<-*>)/(t)d^. 



The theorem foUows immediately. A 
Assume that 

'^y-^TT^f \f(.t)\'imr'dt <oc (21) 

in addition to the hypotheses of Definition2.1 and Theorem2.3. Then using the 
Cauchy-Schwarz inequality, we get 

\^'^) JR^ K^'^l JR^ 

= {K^^Hx)f-c}. (22) 



To cope with generalized Fourier transforms, we proceed as before and need 
the following definition. 

Definition 2.2 A function f : R" > R is dominated by a radial basis function 

(p satisfying \15]) and \lb]) on i?" — {0}, iff f has a generalized Fourier transform 
f coinciding on i?" — {0} with a continuous function satisfying Y21]) for ijj{x) = 
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Remark: The set of functions dominated by (fi may be completed to form a 
Hilbert space with inner product 

Jr." 

which was thoroughly studied by Madych and Nelson in U, 

Theorem 2.5 /// is in the space of functions dominated by a radial basis 
function (j) satisfying J^lf^) and J^lb]) . then the interpolation error can be bounded 
by 

_ f(t^){x)\ < kII'\x) ■ Cf (23) 

, where c/ is given by (|21|l . 

Proof: This is an immediate result of the above arguments. A 

Theorem 2.6 Let (p satisfy the assumptions of Theorem2.3, and let p G i?>o 
be given. Then there exist positive real constants Hq and C such that for any 
distribution of centers Xi S i?", 1 < ? < M, and any point x € i?" with 
hp{x) < ho the Kriging function can be bounded by 

4^Hx) < C ■ h^~^''\x) (24) 

for < < ^■ 

Proof: omitted. A 



3 Crucial mistakes 

The first mistake occurs in (|14f) . The formula holds only when |/^| is even. Let's 
check the equation in detail. 

U^AU ~ 2U'^R^^'\x) + V^^^^(O) 

M M 

- y^jE«,e'<--*>P^(0rfi-2E«, • ^ jJ^tre^<^-^^''>mdt 

M M 
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Now, 

M 



1 /• ^' M 

M M M 

+{itY ■ JEj^}ip{t)dt 

M M 



fj,^i<x—Xj ,t> 



1 



■\ r ^ 1 /• 



3=1 ' ' i=i 

M 



- 2C/^i?(^) (x) + (-l)l''IV'(^''nO) whenever \n\ is even, 
[/■^^JJ + (-l)l'^IV^^^nO) whenever is odd. 

Note that it's better to add a constant (— l)!**! to ip^'^i^\0) in the definition of 
the Kriging function. 

The second mistake occurs in the proof of Theorem2.3. There are three 
problems in the proof. The first problem is that the Fourier transform Gm{z) 
of Gm is wrong. Let's show it. 



Gm{z) 

K- [ Gm{t)e-'<'''>dt 



(27r 



V / l5t/(^)^-ll*ll^/™^e-^<^'*>d^ 



{2n 

^ » M M 

e-lltf/™\e-'<-.*>dt 
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M 

^i<Xi —x,t> 



M 

-^^^-(^^)''e'<^-^^'*> + (if)^(Ii)^]e-ll*ll'/™' • e-*<^'*>di 

(27r)»y«„^ 
+ 7—— / > u-jhtYe' 



M 



3- 
M 



M 

M 

o-mnm"(-l)l^l 7i^D^e-ll^-(^-^^)ll'™'/^ 

+«T„„m"(-l)l''l£>2^e-ll^ll''"'/^ 
, where a^n is some constant independent of m. 

Note that the second and third items of the result cannot be incorporated 
whenever is odd. Now, the second problem arises when we insert Gm into 
(17). We display the process. 

limm^ooj^Xrr [ Gm{z)il){z)dz 
= limm^^-^ ■ amn V ujUk [ m"e-ll--(-^— '=)ll''"'/4 • i^{z)dz 



+lzm„^oo7;7^ • a„„(-l)l'^l / ^"D^'^e-ll^ll'"'/^ . ^(^^^^ (25) 

{Z-K) J fin 
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Wu and Schaback conclude that the hmits of the four integrals of the right-hand 
side are equal to 

i}{xj -Xk), {-l)^''^D'''tlj{xj -x), {-l)^''^D'''iP{x~Xj) and D^i'^iO) 

respectively, by applying (5-function. However, by p. 217 of V' should be a 
good function when applying (5- function. That is, ip should be a member of 
the Schwartz space. Fortunately, as long as we require to be in C^, then 
(5-function still works even if ip is not a good function. This can be shown as 
follows. 

/oc 
{m/^T)"/^{^|;{x) - tp{0)}e'"'''' dx. 
OO 

Since 

\ip{x) - i^{o)\ = — — dt2 + --- 

dtp{xi,X2, . . . ,t„) ^^ 

< M(|xi| + |a;2| + --- + |a;„|) 
the integral does not exceed Mn/rri^/'^ which tends to zero as m — > oo and 

5{x)ij{x)dx = V^O) 

— oo 

is justified. 

What's making trouble is the derivative. This is the third problem. We 
know that for any generalized function g and good function 7, 

[df ■ ■ ■ dl-g{x)}^{x)dx = {-If f g{x)d^^{x)dx 

where g = ((Ji, • ■ • The requirement that 7(3:;) be a good function is abso- 
lutely necessary and cannot be modified. Thus the second and third integrals 
in the right-hand side of (25) cannot be reduced to {~l)^'^^D^^'ip(xj — x) and 
(_1)Ia'|£)A'^^2; _ 2;^.) respectively. Moreover, the item ^''•^^''(0) needs a coeffi- 
cient (— l)l''l also. These bad mistakes destroy (|18|) thoroughly. 

The third crucial mistake occurs in (22) whenever / and ip are generalized 
functions. Note that (22) is a result of H2U|) which is also proven as follows for 
the generalized case. 

Let gu{t) = 'Ef=iu'f \x)e'<'=^'*> - (i<)''e^<^'*>. Then, by Lebesgue Con- 
vergence Theorem, 

gu{t)f{t)dt - Um„,^^-^ [ gu{t)e-\\*'\\"/^"'" j{t)dt 



(2^)" yfl„ ' " " ^--,n^^ ^27r)« Jj^ 
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= limm^ao-TTTT^ f Gm{z)f{z)dz 
(27r)" 

where Gm{t) := gc/ We" 
The Fourier transform Grn(z) can be calculated as follows. 

1 r ^ 

G^{z) = -V/ [yM^'^^(a;)e'<"^'*>-(ii)''e'<"'*>]e-ll*ll'/'"'e-^<^'*>rft 
(27r)" Jj^„ 

1 ^ f 



1 ^ 2 1 /• 

tt)" ^ ^ ^ (27r)" ^ ' J J,, 



(27r)" ^ ^ (27r)" ^ ^ 



Now, 



ZimTO^oo7;A— / Gm{z)f{z)dz 

M 

= lim. 



M „ ^ 



M 



= (^E-r - (^(-1)"^' • (-1)"" •^''/(-) 

Hence we get (22) up to a constant for the generalized case. 

In the above course, we also use the technique of ^-function and the derivative 
of generalized function. Mistakes occur again since / is not a good function. 
However, if |^| = 0, the above argument still holds as long as we require / to 
be a C^-function. 
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We conclude that Wu and Schaback's error bound can be used only when 
— with an additional restriction that both -ip and / should be in 
classically. What's noteworthy is that one should avoid using this error bound 
when -0 is a thin-plate spline. As for multiquadrics and Gaussians, it still works. 

The significance of derivatives should be explained here. We know that 
derivatives reflect smoothness. If the approximand and approximant can match 
in smoothness, it will be nice. 1 fear r.b.f. people probably overemphasize the 
infinitely differentiable multiquadrics. Of course, multiquadrics are a very useful 
tool in the multivariate scattered data interpolation. However, as pointed out 
by Yoon in 0, most data points do not arise from extremely smooth functions. 
If this is true, multiquadrics are not very satisfactory in most cases. An example 
can be given here. It's well known that Weierstrass raised a function which is 
everywhere continuous, but is everywhere undifferentiable. If we approximate 
such a function by multiquadrics, it's meaningless even though its error bound 
is small. Although this example is a bit too drastic, it provides an evidence that 
sometimes we do have to consider the matching of smoothness. What's note- 
worthy is that in the practical problems of differential equations, most solutions 
are at most or functions. They are not very smooth. 

I personally believe that unsmooth functions should be approximated by 
unsmooth functions. In fact, this is the central idea of this paper. 

4 Comparison of the function spaces 

In Wu and Schaback's approach, the space of approximated functions is 
defined to be the set of all functions from R" into R which has a generalized 
Fourier transform / coinciding on i?" — {0} with a continuous function satisfying 



for ■>Jj{x) = (/"(lla;!!) satisfying (^Hl and 

Many people mistake Wu and Schaback's space for Madych and Nelson's 
space of approximands. This may lead to a disaster. 

Madych and Nelson's space is much more complicated to describe than 

that of Wu and Schaback. However, L-T. Luh has made a clear characterization 
for Madych and Nelson's space which is easier to understand. Let's follow Luh's 
notation and definitions in and 

In the following definitions, fl denotes an arbitrary subset of R" and 
denotes the set of n-variable polynomials of order not exceeding m. 
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Definition 4.1 {P,l)^, := {Y,Zi c^^^M^ £ C, e fl for 1 < i < N, Y.ti c^p{x^) 



= for all p e Pm} where S^^ is a measure defined by (E) 
for any subset E of i?" . 

We can construct a norm in define 



1 if e E 
if x,^E 



N M 



(A, [i)^ — V V \il^Mx, - yj) 



for A,^ G with A = X^ili \^x,, M = Yl!f=\ l^i^vj-, it's easily seen (■, ■)^ 

is an inner product and induces a norm in [P^q^ as long as V' is c.p.d. of order 
m in f2. 



Definition 4.2 {Pm)ii is the Hilbert space completion of {P^)^ under the norm 
induced by ip. 



Definition 4.3 F^,n := {f{x) = {fi, G {P^)q, x e fl, (■, mner 

product in (P," )q induced by ip} where ^(j;) := '^a;~X]"=i h{x)6xi with li, . . . , Im' 
a basis of P^ and Xi,. . . ,Xm' G ^ satisfying li{xj) — 6ij. 

Definition 4.4 Let t/j be c.p.d. of order m > in fl. Then 

c^,{n) = pzm ® F^ 

where ® denotes the direct sum of two linear spaces. 

In fact, Madych and Nelson's space of approximands is just C^(i?"). 

In Wu and Schaback say that the completion of is just F^ j^d. Some 
authors even say that F^ is equal to C^{R'^). See [2] and [H|- 

In order to make a lucid clarification, I must quote two theorems of 

Theorem 4.1 Let ip be continuous and conditionally positive definite of order 
m. Then it is possible to choose a positive Borel measure fi on i?" — {0}, 
constants a^, I7I < 2m and a function x in T) such that: 1 — x(0 has a zero of 
order 2m + 1 at = 0; both of the integrals /o<|^|<i \S.\'^"^d^{^), /|j|>i d^{£^) are 
finite; for all a ^T), 

j^{x)a{x)dx^ JiaiO-m E ^M0)^]rf/i(O+ E ^^0)^- 

|7|<2m |7|<27n 

(26) 

This uniquely determines the measure /i and the constants a^ for I7I = 2m. In 
addition, for every choice of complex numbers Cq, \a\ = m, 

E E ^a+l3'^aCi3 > 0. 
[a|=m \f3\—m 
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Theorem 4.2 Let m^ip^fi and he as in Theorem4-l- Assume dfj,{^) = 
'w{^)d^ and — for all \j\ — 2m. Let p be the Borel measure on i?" de- 
fined by dp{^) = r{£^)d£,, where r is defined by 

with r(^) = oo when w{—^) = 0. Then f £ C^{R^) if and only if f E S' and 
{D°'f)'^ G L^{p) for every \a\ ~ m. Ln that case, (/, /)^ is given by 

E ^ii(^"/riii^(p)= / i3i'rfM = (/,/u 

I o^- J 

a I — m 

where g is defined in Propositions. 2 of 

By Theoreni4.2, one easily finds that Wu and Schaback's is equal to a subset 
of Madych and Nelson's C^(i?") when to = 0, with the same norm. Here, one 
should be careful. Wu and Schaback's space consists only of real-valued func- 
tions. However, Madych and Nelson's space contains complex-valued functions. 
When m > 0, the two spaces cannot be compared. For to > 0, the Hilbert space 
completion of still has nothing to do with C^{R^). 

Now, another big problem of Wu and Schaback's error bound can be pointed 
out. That is, there is no reason to believe that the generalized derivative f''^\x) 
in H23|) coincides with a nicely behaving classical function. This question is abso- 
lutely nontrivial. Although some people may add this condition as an additional 
requirement, this will become a drawback because it's rather restrictive. Madych 
and Nelson deal with this problem perfectly in their paper In their theory 
the generalized derivative coincides naturally with a nicely behaving classical 
function. However, it's suitable only for C^(i?"). Moreover, Madych and Nel- 
son's space C^{R^) seems to be more meaningful than Wu and Schaback's space 
Frf, for two reasons. First, it has a natural interpretation in physics. Second, it 
contains a dense subset which consists of natural extensions of the univariate 
cubic spline. The two reasons are very strong. All these can be found in 0]. 

In fact, not only Wu, Schaback and Yoon, but also many others misunder- 
stand the two spaces. The main reason is that Madych and Nelson's papers are 
very difficult to read. In order to get a better understanding to their papers, it 
might be helpful to read |0 and |3] first. 

Finally, I would like to point out a key point of the comparison of the two 
spaces and the two error bounds. It's well known that there are two notions of 
generalized Fourier transform. One is the Russian notion of Gelfand and Schilov. 
The other is the French notion of Schwartz. Many people think the notion used 
by Madych and Nelson in |5 is the Russian notion. In fact, this is wrong. What 
they use is still the French notion. This can be seen in page 213 and page 219 of 
Madych and Nelson studied Duchon's works and tried to promote it. That 
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probably is the reason why they use the French notion of generahzed Fourier 
transform. Unfortunately, in the bibliography of only Gelfand and Vilenkin's 
book " Generalized Functions" , Vol.4, 1964 appears. None of Schwartz, Jones, or 
Stein/Weiss's book appears. This misleads people into thinking that the notion 
used by them is the Gelfand/Schilov's definition. This seems to be part of the 
reasons many people do not like Madych and Nelson's approach. They prefer 
Wu and Schaback's approach which uses the better digestible French notion. 



References 

[1] Jones, D.S., The Theory of Generalized Functions, Cambridge University 
Press, Cambridge 1982 

[2] Luh, Lin-Tian, The equivalence theory of native spaces, Approx. Theory 
AppL, 17:1,2001, pp. 76-96. 

[3] Luh, Lin-Tian, The embedding theory of native spaces, Approx. Theory 
AppL, 17:4, 2001, pp. 90-104. 

[4] Madych, W.R., and Nelson, S.A., Multivariate interpolation and condition- 
ally positive definite function I, Approx. Theory AppL, 4(1988), pp. 77-89. 

[5] Madych, W.R., and Nelson, S.A., Multivariate interpolation and condition- 
ally positive definite function II, Math. Comp., 54(1990), pp. 211-230. 

[6] Wu, Z., and Schaback, R., Local error estimates for radial basis function 
interpolation of scattered data, IMA J. Numer. Anal. 13(1993), 13-27. 

[7] Yoon, J., Spectral approximation orders of radial basis func- 
tion interpolation on the Sobolev space, SIAM J. MATH. ANAL. 
Vol.33,No.4,2001,pp.946-958. 

[8] Yoon, J., Interpolation by radial basis functions on Sobolev space. To appear 
in J. of Approx. Theory, 2001. 

Department of Applied Mathematics, 

Providence University, 

Shalu Town, 

Taichung County, 

Taiwan 

Email:ltluh@pu.edu.tw 



15 



